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Lecture 20. Thursday, April 23: Spectral theorem for compact 

SELF-ADJOINT OPERATORS 

Let A e IC(H) be a compact operator on a separable Hilbert space. We know of 
course, even without assuming that A is compact, that 

(20.1) Nul(A) C H 

is a closed subspace, so Nul(A) 1 - is a Hilbert space - although it could be finite- 
dimensional (or even 0-dimensional in the uninteresting case that A = 0). 

Theorem 15. If A e JC(H) is a self-adjoint, compact operator on a separable 
Hilbert space, so A* = A, then null^)- 1 has an orthonormal basis consisting of 
eigenf unctions of A, Uj such that 

(20.2) Auj = XjUj, Xj e R \ {0}, 

arranged so that \Xj\ is a non-increasing sequence satisfying Xj — > as j — > oo (in 
case Nul(A) 1 - is finite dimensional, this sequence is finite). 

Before going to the proof, let's notice some useful conclusions. One is called 
'Fredholm's alternative'. 

Corollary 4. If A € IC(Tl) is a compact self-adjoint operator on a separable Hilbert 
space then the equation 

(20.3) u-Au = f 

either has a unique solution for each f £ H or else there is a non-trivial finite 
dimensional space of solutions to 

(20.4) u - Au = 

and then (20.3) has a solution if and only if f is orthogonal to all these solutions. 

Proof. This is just saying that the null space of Id —A is a complement to the range 
- which is closed. So, either Id — A is invcrtible or if not then the range is precisely 
the orthocomplcment of Nul(Id— A). You might say there is not much alternative 
from this point of view, since it just says the range is always the orthocomplcment 
of the null space. □ 

Let me separate off the heart of the argument from the bookkeeping. 

Lemma 14. If A € JC(TL) is a self-adjoint compact operator on a separable (possibly 
finite- dimensional) Hilbert space then 

(20.5) F(u) = (Au,u), F :{ueH; \\u\\ =1} — > R 

is a continuous function on the unit sphere which attains its supremum and infi- 
mum. Furthermore, if the maximum or minimum is non-zero it is attained at an 
eivenvector of A with this as eigenvalue. 

Proof. So, this is just like function in finite dimensions, except that it is not. First 
observe that F is real-valued, which follows from the self-adjointness of A since 

(20.6) (Au, u) = (u, Au) = (A*u, u) = (Au, u). 

Moreover, continuity of F follows from continuity of A and of the inner product so 

(20.7) \F(u)-F(u')\ < \(Au,u)-(Au,u')\ + \(Au,u')-(Au',u')\ < 2\\A\\\\u- u'\\ 
since both u and u' have norm one. 
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If we were in finite dimensions this finishes the proof, since the sphere is then 
compact and a continuous function on a compact set attains its sup and inf. In the 
general case we need to use the compactness of A. Certainly F is bounded, 

(20.8) \F(u)\ < sup \(Au,u)\ < \\A\\. 

Nl=i 

Thus, there is a sequence w+ such that F(u%) — > supF and another u~ such that 
F(u~) —* inf F. The weak compactness of the unit sphere means that we can pass 
to a subsequence in each case, and so assume that — ^ converges weakly. 
Then, by the compactness of A, Au^ — > converges strongly, i.e. in norm. But 
then we can write 

(20.9) \F(ut) - F(u±)| < |(A( U ± - u ±),„±)| + 1(^*4 - u ±)| 

= |(A(u± - u ± ),«±)| + - « ± ))| < 2||Au± - A U ±|| 

to deduce that i^u*) = limF(u„) are respectively the sup and inf of F. Thus 
indeed, as in the finite dimensional case, the sup and inf arc attained, as in max 
and min. 

So, suppose that A + = supF > 0. Then for any v G H with v _L u + the curve 

(20.10) L v : (-7T, tt) 9 i — > cos 0m+ + sin li- 
lies in the unit sphere. Computing out 

(20.11) F(L v (0)) = 

(AL V (9),L V (6)) = cos 2 6F{u + ) + 2sin(26») Rc(Au+, u) + sin 2 (8)F(v) 

we know that this function must take its maximum at 9 = 0. The derivative there 
(it is certainly continuously differentiablc on (— it, tt)) is Rc(Au + ,v) which must 
therefore vanish. The same is true for iv in place of v so in fact 

(20.12) (Au + ,v) = 0Vd1m + , = 1. 

Taking the span of these v's it follows that (Au + ,v) = for all v _L u + so A + u 
must be a multiple of u + itself. Inserting this into the definition of F it follows 
that Au + = A + u + is an eigenvector with eigenvalue A+ = sup F. 

The same argument applies to inf F if it is negative, for instance by replacing A 
by — A. This completes the proof of the Lemma. □ 

Proof of Theorem 15. First consider the Hilbert space Ho — Nul(A)- 1 C H. Then 
A maps Ho into itself, since 

(20.13) {Au, v) = (u, Av) = V u G H , v G Nul(A) =^Aue W - 

Moreover, Ao, which is A restricted to Ho, is again a compact self-adjoint operator 

- where the compactness follows from the fact that A(B(0, 1)) for B(0, 1) C Ho is 
smaller than (actually of course equal to) the whole image of the unit ball. 

Thus we can apply the Lemma above to A , with quadratic form F , and find 
an eigenvector. Let's agree to take the one associated to supi 7 ^ unless sup Aa < 

— inf Fo in which case we take one associated to the inf . Now, what can go wrong 
here? Nothing except if Fq = 0. However, 



Lemma 15. In general for a self-adjoint operator on a Hilbert space 
(20.14) F = ^> A = 0. 
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Proof. In principle F is only defined on the unit ball, but of course we can recover 
(Au, u) for all u e H from it. Namely, if u = it vanishes of course and otherwise 

(20.15) (Au,u) = \\u\\ 2 F(^). 

IMI 

Thenxs we can recover A by 'polarization'. Since 

(20.16) 2{Au,v) = (A(u + v),u + v) + i(A(u + iv,u + iv). 

Thus if F = then A = 0. □ 

So, we know that we can find an eigenvector unless A = which would imply 
Nu1(j4) = H. Now we proceed by induction. Suppose we have found N mutually or- 
thogonal eigenvectors ej for A all with norm 1 and eigenvectors Xj - an orthonormal 
set of eigenvectors and all in Ho- Then we consider 

(20.17) H N = {u e H Q = Nul^)- 1 ; (u, e } ) = 0, j = 1, . . . , N}. 
From the argument above, A maps Hn into itself, since 

(20.18) (Au,ej) = (u,Aej) = Xj{u,ej) = if u e H N => Au e H w . 

Moreover this restricted operator is self-adjoint and compact on Hat as before so 
we can again find an eigenvector, with eigenvalue cither the max of min of the new 
F for Hn- The only problem arises if F = at some stage, but then A = on 
Hn and since Hn -L Nul(A) this implies Hn = {0} so Ho must have been finite 
dimensional. 

Thus, either Ho is finite dimensional or we can grind out an infinite orthonormal 
sequence a of eigenvectors of A in Ho with the corresponding sequence of eigen- 
values such that | Ai| is non-increasing - since the successive i*Vs are restrictions 
of the previous ones the max and min are getting closer to (or at least no further 
from) 0. In fact it follows that Xj — > in this case, since otherwise there must be 
one eigenvalue A ^ for which the space of eigenvectors is infinte dimensional - 
ruled out by the fact that X(ld—X~ 1 A) has finite dimensional null space as shown 
last time. 

Finally then, why must this orthonormal sequence be an orthonormal basis of 
Ho7 If not, then we can form the closure of the span of the e, we have constructed, 
H', and its orthocomplcmcnt in Ho - which would have to be non-trivial. However, 
as before F restricts to this space to be F' for the restriction of A' to it, which is 
again a compact self-adjoint operator. So, if F' is not identically zero we can again 
construct an eigenfunction, with non-zero eigenvalue, which contracdicts the fact 
the we are always choosing a largest eigenvalue, in absolute value at least. Thus in 
fact F' = so A' = and the eigenvectors form and orthonormal basis of Nul^)- 1 . 
This completes the proof of the theorem. □ 



